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An image encoding method, and an apparatus therefor, 
enabling rapid comprehension of the outline of the en- 
tire image promptly, at the decoding of the encoded 
image information, and also an image encoding method, 
and an apparatus therefor, capable of efficient encoding 
adapted for the state of the image to be encoded. Image 
information is divided into plural block, each consisting 
of plural pixels, the frequency of the image in each 
block is analyzed, the frequency components of the 
image in each block are separated into plural bands, and 
the frequency components contained in each of said 
plural bands are encoded.' 
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sample data constituting each block as an N-dimen- 
METHOD AND APPARATUS FOR ENCODING sional Euclidean space RA*. and executing a mapping 
FREQUENCY COMPONENTS OF IMAGE conversion on R"for a finite number of subsets. Conse- 

INFORMATION quently the number of dimensions of such Euclidean 

BACKGROUND OF THE INVENTION ' ^TJl"^^ I^v, £!* ^l}™***- 

and a corresponding hardware becomes difficult to 

1. Field of the Invention realize. 

The present invention relates to a method of encod- For avoiding such drawbacks, it has been tried to 
ing an image in the unit of a block of pixels, by dividing incorporate many edges into the training images, or to 
image information into plural W^jach consisting of 10 ^ traini 

plural pixels, and a method of decoding the encoded tr™,«™ .u- -^.Z* . . . . 

data obtained by such encoding, and an apparatus for However, the reproduction vector designed in such 

executing such encoding and decoding. ma ™ er P rov,des , an ""natural digitized image. 

2. Related Background Art Though it is also possible to classify the images by 
Since the amount of data encoded from an image is 15 their nature and to design the reproduction vector for 

far larger than that of other encoded characters or sym- each class of images, but such method does not provide 
bols, there have been proposed various methods for fundamental solution, because, as already explained 
compression, encoding and transmission for facilitating above, the amount of information is larger in the edge 
data storage and transmission. areas than in the areas of flat image density. Also such 

In order to achieve highly advanced compression of 20 method does not throw light in solving the above-men- 
continuous tone images or multi-level density images, tioned drawbacks relating to the amount of calculation 
there has been proposed to encode such images in the required or the difficulty in realization of hardware, 
unit of a block of pixels, by dividing the image mforma- Furthermore, in the storage or transmission of the 
tion into plural blocks each consisting of plural pixels data encoded fa the unh of block the ^ roduced 

Particularly m yiew of data storage, attention is at- 25 deteriorated due to a 

tracted by the method of vector digitizing each image ^ . . . , . - " . . 

block consisting of plural pixels, as such method is theo- d ^ ortlon . ln resulting from the transmission 

retically capable of achieving performance close to the characteristics of the system. 

limit of rate distortion. Furthermore, there may be required various image 

In such vector digitization, the reproduction vector is 30 processings, such as image sharpness enhancement, for 
designed in advance by a training process with various tne transmitted image. 

images, and a reproduction vector, which provides a However the correction for the distortion in the 
minimum distortion for the input image at the encoding, transmission characteristics or the various image pro- 
is utilized as the code for encoding. Consequently the cessings are sometimes required for the entire image or 
optimum designing of the reproduction vector is an 35 sometimes for certain frequency components only, and 
important factor in the vector digitization. In general, the conventional encoding method has been unable to 
the optimum reproduction vector is determined by a satisfactorily respond to such requirements, 
vector digitizing algorithm^ called LBG method. Qn the other hand, in such encoding in the unit of a 

This method, however, being based on a principle^ blockf the detailed ori ginal image is reproduced in the 
minimizing the average distance between the image for 40 . - . . . . r — ^ 

training pfocess and The reproduction vector, tends to mt « bl °* * y "v™.*"?* Ponton. Consequently 
piovide a reproduction vector that is biased by the s^ch encoding method, m which the image is repre- 
average images for training process. scnted bv the ent,re encoded data, is not suited for a 

Also the vector digitizer is designed with such train- quick-response transmission, such as transmitting a part 
ing process utilizing various images involving different 45 of encoded data at first for showing the outline of 
spatial frequency, but, because usual images frequently ^ e entire image and then transmitting the rest of the 
contain areas of flat density, the image decoded from encoded data for improving the tonal rendition and 
the encoded signals often shows image quality deterio- resolution of the image. Also it is not suited for such 
ration in the areas involving high spatial frequency transmission as sending detailed data for certain image 
components, such as in the image edges, through such 50 areas containing denser original information and send- 
image quality deterioration is less in the areas of flat ing rougher data for the remaining image areas, 
image density. This is due to a fact that the percentage For the purpose of improving man-machine interface, 
of edges is less in the training images, and that the there has recently been desired an encoding method 
amount of information larger in such edge areas than in capable of sending rough image information at first and 
the areas offlat image density. » progressively improving the resolution with the lapse of 

Another drawback lies in a fact that the amount of ^ ^Tehy reproducing the detailed image informa- 
calculation "quired for designing the diptizer increases d but the encodin methods havc ^ - 

logarithmically with the increase of number of order of /, , ^ - . . . ■ 

the vector. Moreover, even if the reproduction vector un T abI ? t0 ^tisfactordy respond to such requirement 
can be designed, the amount of calculation required for 60 * n conventional data compression encoding meth- 
determining a vector of minimum distortion for the ^ cntire una « e cannot * comprehended until the 

input image also increases logarithmically. encoded data of all the plural block constituting an 

Furthermore, the magnitude of the required hard- image are decoded, 
ware will be enormous. Particularly the vector digitiz- Consequently, in case of retrieving a desired image 

ing of complete-search type is practically impossible to 65 from the stored encoded data of plural images, the user 
realize. cannot identify whether the currently decoded data 

The vector digitization can be generalized as dividing represent the desired image, until the completion of 
a two-dimensional image into blocks, handling the N decoding. 
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FIGS. 29A to 29C are views showing an example of 

SUMMARY OF THE INVENTION classifying method; 

* ^ r - ^ki«r» nf thp FIG 30 is a flow chart showing a classifying method; 

In consideration of the W- an obj^ of the FIB 30 * a no Sample of band divi- 

present invention is to provide an encoding method, and riv». ji » » e 

an apparatus therefor, capable of satisfactorily encoding 5 s.on^ ^ ^ ^ ^ ^ ^ ^ 

ta 2i553Srf i^SSS- is » provide mission of encoded data embodying the present inven- 

tire image promptly, at the decoding of the encoded W a decrter, ^ ^ ^ showing the states of decoding: 

image information. . pro 35 is a schematic view showing another en- 

Still another object of the present invention is to 
provide an image encoding method, and an apparatus • ^ ^ 3? m otIlcr examples of 

therefor, capable of efficient encoding adapted for the ^ ^ ^ of dccoding; ^ 

state of the image to be encoded. Pjq l s a v j cw showing another example of the 

Still another object of the present invention is to enco6eT 

provide an image encoding method, and an apparatus . t .^^v 

therefor capable of accommodating image conversion DESCRIPTION OF TOE PREFERRED 

processes at the decoding of the encoded image infor- ^ EMBODIMENTS 

mation. Now the present invention will be clarified in detail 

Still another object of the present invention is to fey prcferred embodiments thereof, 
provide an image decoding method, and an apparatus At first thfire ^ ^ explained the principle of encod- 
therefor, capable of providing a satisfactory reproduced jng emp i 0 y C< j m t h e present invention, 
image in a simple manner at the decoding of the en- 25 p^tiy ft i$ tried to reduce the number of dimensions 
coded image information. 0 f t he N-diraensional Euclidean space by dividing it 

The foregoing and still other objects of the present mtQ p]ura i sub-Euclidean spaces. This is achieved, for 
invention, and the advantages thereof, will become cxamp ie. by dividing the interior of the block into sub- 
fully apparent from the.following description. blocks and effecting vector digitization in each sub- 
nrcroTPTinw OF THE DRAWINGS 30 block. Consequently the sub-block, containing pixels of 

BRIEF DESCRIPTION OF THE DRAWING ^ number M smaller than N, constitutes an Euclidean 

FIG. 1 is a block diagram showing an encoding appa- spa ce R^. A vector digitizer can be realized by select- 
ratus embodying the present invention; i ng M at a value allowing practical hardware prepara- 

FIGS. 2A and 2B are schematic views showing the ^ Qn 
concept of Hadamard transformation; 35 For facilitating the division into such sub-blocks, the 

FIG. 3 is a chart showing a sequency component; data Q f t fc e block are transformed for example into a 

FIGS 4A and 4B are charts showing an example of frequency space. For this purpose an orthogonal trans- 
band division; formation into the frequency space is conducted in the 

FIG. 5 is a flow chart showing the control sequence un j t c f each block, 
of classification; .40 Information sources with a high level of correlation, 

"FIG 6 is a view showing the structure of encoded sucn as images, generally show power concentration in 
data . the low frequency components in the frequency analy- 

FIGS 7A and 7B are views showing an example of s j s . This property is utilized in forming the sub-blocks, 
image classification; Namely, an orthogonal transformation is conducted on 

FIG 8 is a view showing the transmission format of 45 the image, then the coefficients of such transformation 
encoded data; are analyzed to divide the image into sub-blocks accord- 

FIG 9 is a block diagram of an example of the receiv- j ng to the property thereof, i.e. according to the Pre- 
mg circuit- - quency, and each sub-block is independently vector 

FIG lO is a nartial detailed view of the circuit shown digitized. Such division into sub-blocks, conducted in 
m VlG V *> the frequency space, shall be called band division. Such 

FIGS. 11 and 13 are views showing the transmission method dispenses with a large amount of calculation 
format .of encoded data with attached parameters; and a corresponding hardware. 

FIGS 12. 16 17 18 19, 22 arid 26 are views showing Secondly, after the band division or a block, if saia 
other transmission 'formats of the encoded data; block has a large percentage of low frequency compo- 

FIG 14 is a flow chart showing a conversion se- 55 nents, the low frequency bands alone are transmittea. 
auence- This is because, in the flat density area (low frequency 

FIGS ISA and 15B are views showing an example of area) of the image, the high frequency components are 
Laolacian filter not required and the low frequency components alone 

FIGS 20A to 20C and IS are views showing other need to be transmitted. Such operation shall be called 
<^i%fme£^ 60 classification. Such classification is made solely by the 

FIG 21 is a flow' chart showing another classifying information on the components in the block, and the 
sequence ima * e ^ ]iXy deterioration m < hc cdge arcaS of *** 

FIGS 23 and 24 are block diagrams showing other image can therefore be prevented. 
• ~fm»w 7f Encoder Thirdly, there is employed a.transmission system, for 

^IG 27 is a schematic view of an encoder for execut- 65 thus band divided and classified encoded ^Ttr^ 
the method of the present invention; mitting each frame from the low ^^^^ 

F GS 28A and 28B are views showing the concept high frequency portions in succession More specifi- 
of HadanSJ transformation; ca»y. at first the encoded data of a low frequency por- 
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tion of the blocks are transmitted for an entire frame, 
then the encoded data of higher frequency are transmit- 
ted for the entire frame, and those of a still higher fre- 
quency are transmitted. The decoding process is corre- 
. spondingly repeated at the receiving side, so that the 5 
resolution of the decoded image is improved in succes- 
sion from lower frequencies to higher frequencies. Such 
transmission system, called progressive transmission, 
realizes a rapid transmission response in the coarse im- 
age, and also the transmission may be terminated in the 10 
course of transmission. Such progressive transmission is 
conducted in the unit of band obtained by orthogonal 
transformation of the image, and various operations are 
executed for each band as will be explained later. 

In such progressive transmission, the outline of the 15 
image can be seen only with the transmission of the low 
frequency bands, since most power is concentrated in 
the flat density areas (low frequency areas) of the image 
as explained before. Also the low frequency bands can 
be transmitted at a high speed, by selecting shorter code 20 
lengths for the image of the low frequency bands. 

Fourthly, in the progressive transmission of each 
band, there are applied various transformations, such as 
the correction of frequency (modulation transfer func- 
tion) of the image, extraction of edges of Affine trans- 25 
formation, for each band either in the real space or in 
the frequency space. 

In the following there will be given detailed explana- 
tion on the embodiments of the present invention, utiliz- 
ing such encoding and transmitting methods as ex-- 30 
plained above. 

FIG. 1 is a schematic view of an image encoding 
apparatus embodying the present invention. 

An orthogonal transformation unit 1 executes an 
orthogonal transformation on each block (unit block in 35 
the present embodiment being composed of 4 X 4 pixels) 
of an image entered through a signal line 10. In the 
present embodiment an Hadamard transformation of 
4X4 pixels is employed as said orthogonal transforma- 
tion. Said Hadamard transformation converts, the, image, 40 
of each unit block, consisting of 4X4 pixels, into 16 
transformation coefficients (Yijt Y12. . . • Y44). A signal 
line 11 is used for said transformation coefficients. FIG. 
2 shows the concept of the Hadamard transformation. 
The pixel data Xn, X«, . . • , X44 contained in a 4x4 45 
matrix block shown in FIG. 2A are converted, by the 
Hadamard transformation, into sequence components 
Yu. V12, • • • » Y44shown in FIG. 2B, respectively corre- 
sponding to the patterns shown in FIG. 3. As will be 
understood from FIG. 3, larger values of i, j correspond 50 
to higher frequency components. • 

The components Y11-Y44 obtained by orthogonal 
transformation in the orthogonal transformation unit 1 
are divided into bands as shown in FIG. 4. FIGS. 4A 
and 4B respectively show examples of division into 4 55 
bands and 3 bands. In case of division into three bands 
shown in FIG. 4B, three components Yu, Y12 and Y21 
constitute a first sub-block, or a band 1 of low fre- 
quency. Then seven componenets Y13, Ym, Y22» Y23, 
Y31, Y32 and Y41 constitute a second sub-block or a band 60 
2 of intermediate frequency and remaining components 
constitute a third sub-block or a band 3 of high fre- 
quency. 

A vector digitizers 4, shown in FIG. 1, efTect vector 
quantization or digitization, respectively of three bands 65 
representing three sub-blocks explained above. The 
vector quantizers Aa-4c are constructed independently, 
and such independent structure for three bands enables 
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to reduce the number of dimensionals and to reduce the 
magnitude of the quantizers. 

Each of the vector quantizers 4a-4c is composed of a 
look-up table, for example stored in a ROM, for select- 
ing an optimum reproduction vector for an input vec- 
tor. It is assumed that such optimum reproduction vec- 
tors are determined in advance, from training data for 
respective bands. 

A classification unit 2, shown in FIG. 1, classifies the 
blocks according to the frequency, by analyzing the 
coefficients Y11-Y44 supplied from the transformation 
unit 1. Said classification unit 2 classifies the blocks into 
four classes according to the frequency, and releases 
classification data of 2 bits to a signal line 12. 

FIG. 5 shows the sequence of classification in said 
classification unit 2. 

In this embodiment there are employed following 
definitions: 

E\^^i\Y XX \ + |.r, 2 ! + l^il) 
£2--f{|rn| +'|ri4| + 1*22! + 1*231 + mil + 

£3««J-{|y 2 4| + l*33l' + 1*341 + 1*421 + |*4J| + 
l*44|> 

The above-mentioned El, E2 and E3 are average 
values of the bands shown in FIG. 48. 

As shown in FIG. 5, if El ^Tl (threshold value), the 
block is classified as a class 1 (flat area) of low fre- 
quency. If E2^T2, the block is* classified as a class 2 
(medium edge) of intermediate edge), and, if E3=T3, 
the block is classified as a class 3 (large edge) of high 
frequency. A block not satisfying any of the conditions 
El^Tl, E2^T2 and E3^T3 is classified as a flat area 
of the class 1, since the power is low over the entire 
bands. 

According to such classification, the number of bands 
in the data to be transmitted is selected larger for the 
class of higher frequency. 

More specifically, as shown in FIG. 6, the data of the 
band 1 of a length 1 (vector digitized data of the low 
frequency component) only are selected for a block of 
the class 1 (flat area). For a block of the class 2 (medium 
edge), there are selected the data of the band 1 of length 
1 and the data of the band 2 of length m (vector digitized 
data of the intermediate frequency component), and, for 
a block of the class 3 (large edge), there are selected the 
data of the bands 1, 2, 3 of lengths 1, m, n, including the 
vector digitized data of the high frequency component 

A high data compression rate can be expected by 
applying classification and band division to each block 
after orthogonal transformation, and effecting the en- 
coding according to the image quality. This is because 
usual image information is rich in the flat density areas 
of the class 1 that can be represented by short data 
length. As shown in FIG. 6, the data of each class are 
preceded by a class code as an index. There are required 
2-bit class codes for representing three classes, as indi- 
cated in the following: 
class 1: class code 00 (binary) 
class 2: class code 01 (binary) 
class 3: class code 10 (binary). 

In some of the embodiments to be explained later, a 
class code 1 1 is used for representing the class 3, for the 
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Z . ii .1.. of the Thus data transmission with an elevated compression 

purpose of convenience Naturally *e length of the I ^us ^ ved { transmiss.on 

class code varies according to the number of ^lass~ SS»„se can be achieved by dividing the image data 

In the following there will be explained the function j^Jf^,. of , OWf inter mediate and high frequency 

of a sequencer 6 shown in FIG. 1. • ? components through an orthogonal transformation, and 

The reproduction vecton5fl-fc, obtained m Ae vec- ^£ ud ^ a bands independently, 

tor quantizers 4o-4e are assembled for each band by the improved image transmission response means 

sequencer 6, and are transmitted for each band, accord- ^ ^ Qf ^ entire ^ ^,^,^1 at first, 

iria to the classification data 12- though the tonal rendition and the sharpness are poor. 

FIG. 7 shows an example of the a*^? 1 *™* 1 ,„ xhelonal rendition and the sharpness of the image are 

classification for each of the block Boo-B„« of a two-di- ^ latef fa superposing the subsequently trans- 

mensional image, (a) indicates the numbers of said ^ ^ i{ b poM to recognize the entire 

blocks, and (b) indicates the results of classification of e ^ - My ^ possible, and to obtain an image of 

said blocks. . r .. , |h _ certain image quality level even when the transmission 

FIG. 8 illustrates the process of transmission of uie fa mterrup ted for some reason, 

data encoded from the image shown in FIG. 7A. A step Such fa$t response b particularly suited for the trans- 

1 transmits the data of the band 1 of all the blocks of a moving i^ge. Also in case of still images, 

Boo-B m « constituting the image frame. A next step 2 recognition of the entire image is important for 

transmits the data of the band 2, and a step 3 transmits retrieval , since the visual observation is common 

the data of the band 3. . . 20 for image searching. . 

In said steps 2 and 3. it is not required to transmit the Ako the high compr ession efficiency is valuable in 

band data of all the plural blocks constituting the image. reducing the time for transmission and reducing tfte 

More specifically, the data of the band 2 are transmitted required for storage. „. . 

corresponding to the blocks of the classes 2 and 3. and " m 10 ^ ows the structure of the reverse Hadamard 

those of the band 3 are transmitted corresponding to the transformer 22 and the memory 24 shown m FKj. ». 

Mocks of the class 3. A developing unit 31 develops data, entered from a 

Whether each block requires data transmission of the sj ^ line 41f int0 Wo cks. At the same time a class code 

bands 2 3 in the steps 2, 3 is identified by the class code, ^supplied from the class code memory 21 through _ a 

JSached to Se data of the band 1 of each block and s ; gna f line 4 2, for defining the spectral position of the 
^smhted wnh said data in the step 1. and said class 30 mput band, through a ROM 32. There arej^ prodded 

c^eb memorized in each block at the receiving side. a reverse converter 33, an adder 34, an image memory 

Tnus the data of the bands 2, 3 are picked up only in the 35 and buses 43, 44. 45. . 

hwlsreGuiring such data, based on said class codes. The class code supplied through the hne 42 

FIG 9 shews the signal processing method at the enters the ROM 32, which provides the 6">*°P™S ™« 
r eceMne sSe A recepfion signal 20. consisting of the 3J 31 ^th positional information f°r the codes supplied 

*&j£^™lL+ln**^to^^ tX orfy containing the transmitted band data and 

t i.j7JIV,f the band 1 in the step 1, are temporarily masked with "0" in other positions. 
Iredta a class Sememory 21.Thedataof theband 40 The 16 data thus generated enters the averse co^- 

1 r»Je rece&^S 20 are decoded by a decoder 26 vcrte r 33 to generate data in the <^™*"E^*£ C 

l^nSL^SSd^Sud data, and are further converted are stored in the memory 35 through the adder 34. If the 

bv a tversrAadamard transformer 22 into real space me mory 35 already stores image .^f.^"^ 

3 ffiSSKE Ss A stored in the class ag ain inth, .memory 35 ^ugh^bus 45. ^ ^ 

code memory 21. in the foUowmg d is^yeTon £ TdU^ay unit 25. Consequently, the 

band components h . ^ reproduced. Subsequently the 

on the dau of the band 2. i~ frequency component is superposed. 

3) class code=3 (binary code 10 ); t» is therefore possible to recognize the image 

'Reverse Hadamard transformation ,s conducted on "^Se decoding of all *e encoded data 

^A'^ttSS*** —---25 „ ffSSSS!^ the Hadamard t~ns- 
band codes (data of the bands 2 and 3) are recognized as 60 J^^^SS^ frequency conversion, but 

the dau of the target block, through comparison with formanon J^Jj**^ or ? nog onal transfer- 

the content of the class code memory 21. as Gestae transformation or K-L transfer- 

data of each block thus obtained are added t°. thedata of 65 S a j ned in , he foregoing, the structure shown in 

previous reverse transformation already stored l» the As explamed m th g g^ for codes obtained 

memory 24, and a final decoded image can be obtained »G. lOprovw ^ ^ ^ 

in this manner. 



0)0: <US 5162923A1 I > 



5,162,923 

9 10 

sisting of pluraJ pixels and encoding the image of each and the data of the bands 2, 3 are picked up only in the 
block with plural encoding data respectively represent- blocks requiring such data, based on said class codes, 
ing different frequency components. In this decoding At the receiving side, the data transmitted in the step 
method, the image information obtained by decoding 1 are stored in the class code memory 21 shown in FIG. 
the encoded data of the first frequency component in 5 9, and, in the step 2, the data of all the blocks are pro- 
later added by that of the second frequency component cessed in succession by the reverse Hadamard trans- 
in the real image space, so that the images of different former 22. The process in the steps 3 and 4 is identical 
frequency components can be reconstructed without with that in the steps 2 and 3 in the preceding embodi- 
complex process. Also it is possible to roughly recog- ment. 

nire the image even in the course of decoding. 10 This embodiment causes a certain delay in the image 

It is furthermore possible to effect various transfer- transmission response because the image data are not 

mation in the course of data transmission in different . transmitted until the completion of the step 1, but the 

bands. In the following there will be explained an exam- * oad °f tne decoder can be reduced as the separation of 

pie correction of the modulation transfer function tne c ^ ass code band data is no longer necessary. 

(MTF), with emphasis of high frequency components. 15 In the following there will be explained the method 

In genera], in a transmission system, the sharpness of of data transformation in the embodiment shown in 

the image is deteriorated as the high frequency signal FIG. 12. 

components are deteriorated by the transfer character- As shown « FIG- 13. parameters 1, 2, 3 representing 

istics of the input unit, analog processing system etc. , n the correction coefficients are transmitted, in the step l t 

For this reason it became necessary to somewhat in- following the class codes. 

crease the gain of the high frequency components in the Lct ^ consider a case of effecting a reverse transfor- 

transmitting of receiving side. raatlon on the orthogonally transformed data at the 

FIG. 11 shows the transmission format of the data «dvlng side to obtain the original read data, and ef- 

when various transformations are required. Prior to the £ * ec £* a s P at,aI filtenn * for ** ch band < or for ste P 

transmission of the data of a band, a coefficients (par am- m \ A h „ . _ 

t -> ~- i\ *v,~ . . 0 FIG. 14 shows a flow chart for said transformation. A 

eters 1, 2 or 3) for tne correction of said bands is transo M . . - . . 

™;tt*A it « oic^ «rtcc;Kio t« «n ste P 101 » corresponding to the step 1 shown w FIG. 13, 

mitted. It is aiso possible to transmit all the parameters *u A j!. ■ *i ; r *• 

... . . r . transmits the class codes and the transformation param- 

12 and 3 m advance. In the embodiment shown m FIG eters Said lransformation paramete r is used, for exarn- 
11, a parameter is transmitted before the transmission of 3 0 p!e m case of edge enhancement, for selecting a 3x3 or 

the data of a band. 5x5 Lap , acian fllter for edge detection as shown in 

Sajd parameter represent a coefficient correspond- FIG. 15A or 15B, or designating^ coefficient 0 in the 

tng to the gain of the data of each band. Thus the Hada- convolution calculation for edge enhancement con- 

mard converted value Y* is given by: ducted according to a principle: 

Y'«aKvalue or band 1) +a 2 (value of band UcI d ata+0.<Laplacian output). 

2)+03-<value of band 3) r K ' 

. , . . . . . . , A step 102 effects the transmission of the data of the 

wherem «,, « 2 andaj are respectively the gams for the bands c ^ responding to the ste s 2 ^». ^ a st , 03 

bands 12 and 3. The high frequency components can w executes the reverse Ha damard transformation, in the 

be emphasized in the reproduced image by selecting transformer 22. for the received band data, and the 

oi<1,02>1 and o 3 >i obtained data are added in the image memory 24. Also 

On the other hand, the low frequency components ^ blocks not requiring th e band data are skipped, 

can be emphasized by a, >l.a 2 <l and ex 3 <l. according to the class codes. 

In such transformation, data: 45 A step 104 executes spatial filtering on the reverse 

• , «./ . •» transformed data, according to the aforementioned 

gam (a,) <vdue of bud 0 parameters. Said parameters may be determined at the 

is transmitted for each band. Such transmission is possi- fC ^„ "A^lf. ' „i, Jm j r „ „_ ■ „j . 

mearly added, and tha the real data can be added after rcction M ^ achievcd ■„ Ms manncr . 

the reverse Hadamard transformation for each band, as In the folIowing there will be explained still another 

the^ Hadamard transformation is a linear transformation. embodiment of the transmission of the encoded data by 

FIG. 12 shows another transmission method of the tne sequence 6 

encoded data by the sequencer 6. The classification and 35 In this embodiment, the step 2 shown in FIG. 12 is 

the band division are conducted in the same manner as executed at first, and is then followed by the steps 1, 3 

in the preceding embodiment, for example on an image ^4 4 

shown in FIG. 7A. In this embodiment, a step 1 trans- - More specifically, at first the data of the band 1 or the 

mits all the class codes of the blocks constituting the i ow frequency component are transmitted. Subse- 

unage frame. Then steps 2, 3 and 4 respectively transmit 60 quently transmitted, in succession, are the class codes, 

the data of the band 1, 2 and 3. data, of the intermediate frequency components and 

In the steps 3 and 4, the band data need not be trans- those of the high frequency components. Therefore, in 

mitted for all the blocks. The data of the bands 2, 3 are comparison with the transmission shown in FIG. 12, the 

transmitted only for the blocks requiring such data. present embodiment quickens the image response, thus 

Whether each block requires data transmission of the 65 providing more rapidly the image represented by the 

bands 2, 3 in the steps 3, 4 is identified by the class code, low frequency components only, 

collectively transmitted for all the blocks in the step 1. In the data transmission shown in FIG. 8 or 12, an 

Said class codes are memorized at the receiving side, improvement in the compression efficiency can be ex- 
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pected by run-length encoding of the class codes. In Also in the step 2 or 3 m the transmission process 

such case an encoder and a decoder for run-length en- shown in FIG. 18, the bits "0" continue in succession if 

coding are respectively required in the encoding and the blocks not having the data of the band 2 or 3 exist 

decoding units. continuously. Such continuous string of the bits "0" can 

In the following there will be explained still another 5 be run-length encoded as shown in FIG. 19. This 

embodiment of transmission of the encoded data by the method can achieve more efficient compression, in 

sequencer 6. comparison with the embodiment shown in FIG. 18. 

The classification and the band division in the present In the following there will be explained an embodi- 

embodiment are identical with those in the preceding mC nt employing different sub-blocks of band division 

embodiment. However, the class code 3 involving the 10 and classification. It is assumed that the band division is 

data of the bands 2 and 3 is represented by "1 T\ and the conducted in the same manner as shown in FIG. 4B. 

data transmission is conducted in steps shown in FIG. For achieving classification employing Hadamard 

16 transformation coefficients, there are defined three edge 

At first a step 1 transmits the data of the band 1 of all quantities as shown in FIG. 20A, 20B and 20G. The 

the blocks constituting the image. Then a step 2 trans- 15 dements in the blocks shown in FIG. 20 correspond to 

raits bit data, of which each bit indicates whether each those m FIG. 2B. FIG. 20 A shows an example of calcu- 

block constituting the image has the data of the band 2. lation for determining the edge quantity ED. Hadamard 

Said bit '*0" or "1" respectively indicates the absence or transformation of an image involving an edge causes 

presence of the band 2. A step 3 then transmits the data power concentration in the hatched area, increasing the 

of the band 2. Then a step 4 transmits bit data, of which 20 value . ED== | y 12 | + 1 Y l3 | + 1 Y 2 i| + | Yn\ + 1 Y« |. 

each bit indicates whether each block constituting the ^his property is utilized in a flow chart shown in FIG. 

image has the. data of the band 3. The bit "0" or "1" ji, in which a block is defined as class 1 (flat area) if 

indicates respectively absence or presence of the band 3. ed^TI (threshold value). Also an image involving a 

Subsequently a step 5 transmits the data of the band 3. vertical edge causes power concentration in a hatched 

In the receiving side, the data of the step 1 are de- 25 arc m p T Q 20B f increasing a vertical edge quantity 

coded in succession. Then, in the step 2,. the data are yE= | Yi 2 | -f | Y»| + 1 Ym|. while an image involving 

stored in the class code memory 21 shown in FIG. 9. In ft hor j ZO ntal edge causes power concentration in a 

the step 3, the data of the band 2 are decoded for the natc hcd area in FIG. 20C, increasing a horizontal edge 

corresponding blocks, based on the data stored in said quantity H£ss i y 2l | + 1 y 31 1 + | y 41 1 , and these proper- 

class code memory 21. In the step 4, the data are stored 30 ^ are utiHzed m ^ classification. Also a slant edge is 

in the class code memory 21 shown in FIG. 9, instead of usuall found if ^ diflemece of the vertical edge quan- 

the data of the step 2, and, in the step 5, the data of the vE'and the horizontal edge quantity | VE-HE| is 

band 3 are decoded for the corresponding blocks, based rties m utilized, as shown in FIG. 

on the data stored in said class code memory »■ 2l for defining the class 2 (vertical edge), class 3 (hori- 

In the present embodiment, the number of transmis- 35 4 ^ ^ } fa p, G ^ 1( T2is * 

sion steps increases but the capacity of the classcode threshoJd g v ^ ue for discrim inating the slant edge, 

memeory 21 of the decoder, shown in FIG. 9, can be 22 showj . thc code formats ^ di ff ercn t classes, 

reduced in comparison with that in the preceding em- ^ cncodcd data corrcsp onding to a flat area of the 

bodiment. . class 1 are composed solely of the data of the band 1, 

In the * e P/ ° f <^ 40 whi e those corresponding^ an e^ge^ontaining area 
the data of the band 3 are only transmitted to all or a 2, 3 or 4 are composed of the data of all the 
part of the blocks to which the data of the band I 2 have or tne c A ^vertical edge, a horizon- 
been transmitted. It is therefore possible ,n one step 4, as ^nos ; i. , frequency components, 
shown in FIG. 17, to transmit bit data 0 or 1, indicating emoloved a class code of two bits for repre- 
whether the data of the band 3 are to be addei only to 45 ^rZ^on vector in 
the flocks where the f^^^J^A^ *e VC ^ 

embodiment requires a somewhat complex process ; in 4 quantization of part-search 

the step 4, but the compression efficiency is further jotte^ ^ ^ ^ 

"Efte" following there will be explained still another 50 FIG. 23 shows an embodiment of the image encoding 

in tne ionowmg inerc wm «c c v , • apparatus. An orthogonal transformer 51 provides vec- 

method I of transmission of the encoded data shown in g^^^ w fo f cncoding ^ Mock output data 

Se classification and the band division are con- with a classification signal 53 mdicating said classifica- 

dueled ii^he ^WenticaT manner as in the embodiment tion. Said signal 53 switches the toble space of a look-up 

shown in FIg/^^ 55 table in the vector quantizer 54, thereby selecting a 

snown m riu ^o, dui ™ ** reproduction vector adapted for each class. 

"A !£ff2^£d£ oJTh/Ld 1 of .11 the A sequent 56 executes, like the sequencer « in the 

blocks to the ™age. In . step 2, a 1-bit signal, indicating preceding embodiment, the uans.mss.on of Ae encoded 

SfpYesence or absence of the data of the band 2 respec- data according to the sequence shown «. PIG 22 and 

tively by "1" or "0". is transmitted for each block, and, 60 depending on the classification signal from « classifica- 

to case of the presence, said signal "1" is immediately tion unit 52. The orthogonal transformer 51 executes 

followed by the data of the band 2. In a step 3, the data Hadamard transformation for each block as in the pre- 

of the band 3 are transmitted in a similar manner as in ceding embodiment, and in the vector quantizing unit 

the steri 2 54, the quantizers 54a-54c execute vector quantization 

In the receiving side, in the step 2 or 3, it is easily 65 for respective bands, 

possible to determine the position of the data of the In the followmg there will be explained an embody 

band 2 from said one-bit signal and to decode the data of ment in which the band diyis.on .s adaptively deter- 

the band 2 or 3 in succession. mined according to the classification. The classification 
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is conducted in the same manner as in the embodiment 
shown in FIGS. 20 and 21. 

In FIG. 24, there is provided a band divider 63, 
which receives a 2-bit signal, indicating four classes 
determined by a classification unit 62. According to the 5 
classification signal, said band divider 63 divides Vi- 
1-Y44 into bands as shown in FIG. 25, respectively 
corresponding to a flat area (class 1), vertical edge area 
(class 2), horizontal edge area (class 3) or slant edge area 
(class 4). In FIG. 25, DC indicates a DC component of 10 
the image in Yn, while "1" and "2" indicate band num- 
bers, and a hatched area is an area to be masked **0" 
without quantization. 

Said hatched area is not quantized because it has very 
low power. Also, the amount of information is gener- 
ally less in the flat area of the image than in an edge-con- 
taining area. Utilizing these properties, the present em- 
bodiment divides the flat area (class 1) into DC and the 
band 1 only, and the edge-containing area (class 2, 3 or 
4) into DC, the band 1 and the -band 2. In this manner 
the redundancy in the flat area of the image can be 
eliminated. In this manner a larger number of bands is 
given to the image involving higher frequency. Also the 
number of dimensions of each band is limited to seven 
or eight, thereby reducing the magnitude of the vector 
quantization, and enabling all-search type digitization. 

The number of bits of encoding in each class can be 
selected as shown in FIG. 26, whereby a larger amount 
of information can be given to the edge portion and the ^ 
rate of compression of encoding can be improved at the 
same time. 

In the example shown in FIG. 26, the class 1 allots 6 
bits to DC and 8 bits to the band 1, whereas the class 2, 
3 or 4 allots 6 bits to DC and 8 bits each to the band 1 35 
and 2. The data of the bands 1 and 2 in each class are 
independently vector quantized by vector quantizers 
64,65. 

In FIG. 24, a signal line 73 is used for transmitting the 
DC componenet of 6 bits, divided in the band divider 40 
63, to an encoder 66. Signal lines 74, 75 are provided for 
transmitting the Hadamard transformation coefficients 
of the bands 1 and 2, divided in the band divider 63, to 
the vector quantizers 64, 65, having look-up tables for 
selecting optimum reproduction vectors in response to 45 
input vectors respectively of the bands 1 and 2. In the 
present embodiment the classification and the band 
division explained above are conducted on various im 



ers, there may be employed a microprocessor for calcu- 
lating the optimum reproduction vectors. 

Furthermore the size or the shape of the unit block 
for encoding is not limited to that in the present embodi- 
ment but can be suitably selected according for example 
to the density of the image to be encoded, and the num- 
ber of classes and the number of bands can naturally be 
selected at optimum values. 

The above-explained image encoding method, for 
dividing image information into plural blocks each con- 
sisting of plural pixels and effecting the encoding in the 
unit of a block, allows to achieve encoding adapted to 
the image in each block, since frequency analysis of the 
image is conducted in each block to classify each block 
as one of plural classes according to the frequency and 
the image of each block is encoded according to the 
class. It also allows encoding without affecting the 
reproducibility of the image constituting each block, 
since frequency analysis of the image is conducted in 
20 each block to classify the frequency components of 
each block into plural bands, and the image of each 
block is encoded independently in said bands. Further- 
more, since each block is divided into plural sub-blocks 
and the encoding is conducted for each sub-block while 
a parameter for modifying said sub-block is attached to 
the encoded data of each sub-block, it is rendered possi- 
ble to effect correction or processing on the encoded 
data, and to effect such correction or processing for 
each necessary frequency component of the image. 

Furthermore image transmission with satisfactory 
transmission response and with a high compression rate 
can be realized, since the image of each block is en- 
coded with plural encoding data for different frequency 
components, and the transmission is conducted in such 
a manner that the encoded data of a first frequency 
component of the entire image is followed by those of a 
second frequency component of the entire image. Fur- 
thermore, as in the image of each block is encoded at 
least in one of frequency components, and the encoded 
data are transmitted with data, indicating the presence 
or absence of the encoded data of other frequency com- 
ponents in each block, it is made possible to dispense 
with the transmission of the encoded data of unneces- 
sary frequency components. The compression effi- 
ciency can therefore be further improved. 

In the foregoing embodiments, the encoded data ob- 
tained by band division are transmitted in an order from 
lower frequency to higher, but another order may be 
preferable for certain images. In the following there 
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ages of different frequencies, and the look-up tables are 

prepared with the optimum reproduction vectors deter- 50 will be explained an embodiment capable of meeting 
mined from independent trainings for the bands 1 and 2. such requirement. 

256 reproduction vectors (8 bits) are determined for At first there will be explained the basic concept of 
each of the bands 1 and 2. However, for the class 1, the the present embodiment. 

vector quantization is conducted only for the band 1. A Firstly, images are information sources of very high 
2-bit classification signal is supplied to the quantizers 64, 55 correlation, and frequency analysis provides different 
65 through a signal line 72 to select the content of the power concentrations depending on the image structure 
look-up tables according to the class. in the block. This property is utilized for identifying the 

An encoder 66 encodes the classification signal 72, state of image in the block, and the encoding is con- 
DC component 73 and vector quantized data 76, 77 of ducted according to the classification. Also at the en- 



the bands 1, 2 to obtain codes of a format shown in FIG. 
26. The image encoded in this manner can be transmit- 
ted through a signal line 78 to a memory or a communi- 
cation channel. 

The above-explained embodiment employs Hada- 
mard transformation for frequency analysis, but there 65 
may also be employed other orthogonal transformations 
such as cosine transformation or K-L transformation. 
Also, instead of the look-up tables in the vector quantiz- 



coding in each class, the block is divided into plural 
bands, and the encoding, transmission and and repro- 
duction are conducted from the band of higher power, 
thereby clarifying the feature of the image rapidly and 
thus improving the man-machine interface. 

Secondly, at the decoding, a most general value, such 
as the central value of the dynamic range or the satisti- 
cal average value, is utilized as the untransmitted coeffi- 
cient to enable rapid recognition of the resolution rather 
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15 , nT The selector 91 is controHer by an unrepresented 

than the tonal rendition for example at the edges ot , ^ m FIG . 27 , pi xel data are supplied 

characters, thus enabling interruption of the transmis. eonum ^ ^ ^ ^ ^ ^ unrepresent e d 

sion or reproduction. . J . imaBe mem0 ry. The access to said memory is made in 

In the following there will be explained an encoder m*g ^ ^ & ^ ^ (f 

and a transmitter employed* ^S^**^ example at the upper left comer) of the image and end- 
mission of the present embodiment. FIG. 27 is a scne f ^ (fof exaoaple at the lower right cor- 
matic view thereof. An orthogonal transformer 21 exe- » ^ cyde of ^ access from said start point to 
cutes orthogonal transformation on each block <£X« end point is repeated four times, 
pixels in the present embodiment) of the image entered elector 91 releases the output codes for each 
Ihrough a signal line 120. In the present embodiment, an ^ ^ by xlectiBg Ac band and DC 
Hadamard transformation on 4X4 pixels B employed as ^ nencts en tered through the singal lines 127. 131, 
the orthogonal transformation, as in the foregoing em- 13 ,^ 3 . 

bodiments. Said Hadamard transformation generates 16 32A shows a first embodiment of the code trans- 
transformation coefficients Y„-Y44, which are trans- firstj of the «, mp ohenets, repre- 
mitted through signal lines 121. FIG. 28 conceptually roughest information and corresponding to the 
show the Hadamard transformation, in which 4X4 avera _ e va i ue s, are sent for the entire image. There are 

pixel data X11. Xu ^ shown in (a) "? co | nvert «! d shown a status code S indicating for example the image 

£to sequence components Y„. Y«. . . . . Y44 shown ,n a „ DC Seating subsequent transmission ofthe 
rM 20 codes of DC components of the blocks until a flag Bi is 

Referring to FIG. 27. a classifier 82 classifies the , ater transm j a ed; and codes DQ(i= 1 A . . . ) of the DC 

blocks, by analyzing Yu-Y44from the orthogonal trans- com po n ents of the blocks. 

former 81, into four classes according to the frequency, A £ f the tr a nsmis sion of the DC component of all 
anTreleases the result of said classification as a 2-bit h Wocks ^ * transmitted the flag B,. indicatuig 
cl£s codTsignal to a signal line 122. FIGS. 29 and 30 transmission of the codes «*~ t '?* 
show tne meSoo of clasfification by the classifier 82. In rough q im age information, until another flag B, n later 
the presenTembodiment. three edge quantities as shown tr JUtted. Then, Cr is a class code »nd,catmg j dieckss 
to FTO» are defined for analyzing the Hadamard of each bIock . Subsequent Tg is an index mdicatrng a 
raSoWation coefficients. The elements in the blocks band most characteristic of the class, among bands 
shown to FIG 29 correspond to those in FIG. 28B M to be c „coded other than the DC components For 
FI(T 28A shows the edge quantity ED. Hadamard example the band Lis assigned to we class 1,2 or 3. and 
Sfo^n of aTimag* containing an edge causes the b Li M is assigned to the cfcss 4 ^and^ch assign- 
or concentration in the hatched area. This property ment is determined m advance for each class, 
power c ° ncent ""°^" k " is dassi fied as 1 (flat area) if The transmission for the class 1. 2 or 3 is conducted in 
iSmtS^^^S^ - FIG. 30. Also an 35 the orde r of bands L. M and H, and that for the class 4 
• :Li.,dtnB a vertical edge or a horizontal edge is conducted in the order of bands M. L and H. 
,mage ■ ve "'" e ~* ical edge quantity VE A flag B 2 indicates transmission of the codes repre- 
ISfIG»B or a farge horizontfl edge quantity W rougher image information, and.fl.gft 
Se showri to F?G. 2^! Furthermore, a small differ- indic a?« emission of the codes represenUng moU 
«,ce I VE-HEl often indicates an image involving a 40 detailed image information. P # (i-1 j— 1, 3) is an 

%X - c£s C 4Tslan ( rSe) as slifn in FIG. 30. in mit ,ed Ff^™** ^SS 1« 3 

V^EffW^.^ divider B ».!a»W^ 

Again ^referring to FIG 27, a o ^ g devd ^150 to 

SSSKf G^a™^ The ponents of said matrix are all "0" except in. band trans- 

hSed^TindLes the ^sitions of data -Uo ^ *> mined tofceo™- cyde. fa , 

encoded. L, M and H respectively indicate low me- a ™^\^ d st0 red in the form of pixel 

dium and high frequency ^"^^d cSf- ^lH?S?~Sy 151 ' ™» the values of . 

^C^ S^^-«-^— --- 
I«dli»el23,•^.quMti«edby.^qu-lto«^J 8 Z^der lS executes addition of each coefficient 
the obtained data are supplied to a selector 9 I through An e ^ 
» signal line 127. The coefficients of the ^L. and H | u PP^^™ ug c * ecutes substitution for the DC 

bands are '^f^-^^^ a S^!S Z£Z£?±*m. » Ae tra.Bforma- 

124-126, to scalar quantizers 85, 86, 87 for utrqw =° P" ft fa h supplied to the transformer 154. 

zation, and the obtained outpu^ ar« ;^r ^ nti"" S the' obtained 'result Stored to the image memory 

plied, through signal lines 128-130, to vector q^""*" 5 thr0 uEh signal lines 165. The stored image is dis- 

Sg_90 for vector quantization £^<*£^2 65 ^frot time to time on a display unit 156. 

sponding indexes, which are supplied tnrougn signal P y ^ illustra ,es an example of code transmission of 

lines 131-133 to the selector 91. fr9nsmis . imace information and decoding thereof explained 

In the following explained is the method of transmis- image imorm 
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An input block X, consisting of 8 bit pixels, is sub- 
jected to an Hadamard transformation in the orthogonal 
transformer 81 to obtain a transformation coefficient 
matrix Y, which is identified as class 4 in the classifier 
82. The transmission is thereafter made in plural cycles. 

In the first cycle, the selector 91 only transmits the 
result of scalar quantization of the DC component. In 
FIG. 34, a bold frame indicates the band transmitted in 
the corresponding cycle. In this state the transformation 
coefficients Y12-Y44. excluding the DC component, are 
not yet transmitted. In 4x4 Hadamard transformation, 
Yn-Y44 assume values in a range from —510 to 510, 
with a central value 0, which is placed in the untrans- 
mitted portion to obtain a transformation matrix Zj. 
This is reverse transformed at the decoding side to 
obtain a reproduced matrix Xi, which is shown on the 
display unit 156. 

As the block is identified as class 4, the selector 91 
transmits, in the second cycle, the quantized coefficients 
of the band M. At the decoding side, the block X) is 
subjected to orthogonal transformation to obtain the 
block Z\ f to which the coefficients of the band M are 
added to obtain a transformation matrix Z2. This is 
again reverse transformed to obtain a reproduced block 
X2, which is then displayed. 

In the third cycle, the coefficients of the band L are 
transmitted and added to the matrix obtained by orthog- 
onal transformation of the block X2 to obtain a matrix 
Z3, which is reverse transformed to obtain a block X3. 
In the fourth cycle, the coefficients of the band H are 
transmitted and added to the matrix obtained by orthog- 
onal transformation of the block X3 to obtain a matrix 
Z4, which is reverse transformed into a block X4. The 
transmission is completed in this manner. 

FIG. 32B shows a second embodiment of the code 
transmission, in which a status code S indicates the 
image size. Different from the foregoing first embodi 
ment, the status code is followed by the' codes rep re 
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senting roughest image information, instead of the DC 4^ but they are not limitative. 



mitted last, since it is quite improbable that the largest 
maximum value appears in the band H. 

At the transmission, the class code of each block is 
accompanied by a code F/ indicating the band. 

Since Y\ \ assumes a value from 0 to 1020 while other 
coefficients assume values from —510 to 510, the com- 
parison in the detector 92 is effected after the subtrac- 
tion of 510 from the value of Yn. 
. FIG. 32C shows the state of transmission of thus 
prepared codes, in which S is a status code as in the 
foregoing embodiments. Also flags Bi, B2, B3 and B4 
respectively indicate transmission of the. roughest, 
rough, less rough and detailed image information. 
There are also provided a class code C/and an index P,> 

In the first, second or third cycle, the codes for each 
block consists of a 2-bit class code Q indicating the 
class; a 2-bit band flag F,- indicating band L, M or DC; 
and indexes P#. The decoding is conducted, based on 
the class code and the band flag. 

Such form of transmission enables the user to obtain 
desired information promptly, as the roughest image. 
Examples of such transmission are shown in FIGS. 36 
and 37, in which X, Y, Zi, Z2, Z3, Z4. Xi, X2, X3 and 
X4 are same as those explained before, and bold frames 
indicate the band transmitted in the corresponding cy- 
cle. In FIGS. 36 and 37, the block X is identified as class 
2, involving a vertical edge. However, in case of FIG. 
36, the transmission is conducted in an order of the band 
L, band M, DC and band H, while said order in FIG. 37 
is the band M, band L, DC and band H. Thus the image 
displayed on the display unit 156 is optimized in succes- 
sion in the order of Xi, X2, X3 and X4. 

In the foregoing embodiments, an Hadamard trans- 
formation is employed as the orthogonal transforma- 
tion, but there may be employed other orthogonal trans- 
formations such as cosine transformation or K-L trans- 
formation. Also a scalar quantization and a vector quan- 
tization have been employed for encoding each band. 



compbnenets. More specifically, at first transmitted is 
the flag Bi indicating subsequent transmission of the 
codes representing roughest image information. Then 
transmitted are the class code C/of each block and the 
codes of the roughest image information of each 45 
block. 

Said roughest image information is the DC compo- 
nenet for a block of class 1, or the codes of the band L 
for a block of class 2 or 3, or those of the band M for a 
block of class 4. 

Then the flag B2, indicating the transmission of rough 
image information, is followed by the codes of the band 
L for the class 1 or 4, or those of the band M for the 
class 2 or 3. 

Then the flag B3, indicating the transmission of less 
rough image information, is followed by the codes of 
the band M for the class 1, or the codes of the DC 
component for the class 2, 3 or 4. Finally, the flag B4, 
indicating the transmission of the most detailed image 
information, is followed by the codes of the band H for 60 
all classes. 

FIG. 35 schematically illustrates another embodi- 
ment of the encoder and decoder, wherein components 
81-91 are same as those in FIG. 27. A maximum band 
value detector 92 detects the maximum value of each 
band, and determined the order of transmission to the 
selector 91 according to the descending order of the 
maximum values. However, the band H is always trans- 
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Also instead of using an encoder for each band, it is 
possible, as shown in FIG. 38, to count the cycles of 
encoding and transmission with a cycle counter 200 and 
accordingly switch a band divider 203, a scaler quan- 
tizer 204 and a vector quantizer 205. The structure of 
the encoder is not limited to such embodiments. Also 
the method of classification and the number of classes 
are not limited. Furthermore the order of transmission 
may be determined based on the comparison of the 
average value in each band. 

As explained in the foregoing, there is provided an 
advantage that the user can recognize the transmitted 
image in an early stage, since the received image is at 
first given roughly and progressively improved in de- 
tails with the lapse of time. Also the selection of trans- 
mitted band according to the state of power concentra- 
tion provides an advantage, of promptly giving tonal 
rendition in the flat area and resolution in edge portions 
such as of characters. 

As explained in the foregoing, the present embodi- 
ment provides an image encoding method for dividing 
the image information into plural blocks each consisting 
of plural pixels and effecting the encoding in the unit of 
a block, wherein each block is encoded with plural 
encoding data and the transmission is started, among 
plural encoded data from those of a band in which the 
transformation coefficient is large, so that the feature or 
content of the transmitted image can be recognized 
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promptly without awaiting the completion of decoding 
of the codes of the entire image. 

The present invention is not limited by the foregoing 
preferred embodiments but is subject to various modifi- 
cations and variations within the scope and spirit of the 
appended claims. 

What is claimed is: 

1. An image encoding method comprising the steps 

^dividing image information into plural blocks, each 

consisting of plural pixels; 
analyzing image frequency in each block; 
separating frequency components of the image m 

each block into plural bands; and 
encoding the frequency components contained in said 15 

plural bands to mutually different predetermined 

length of codes on each band, respectively. 

2. A method according to claim 1, wherein said, sepa- 
rating step performs different separating operations in 
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14. An apparatus according to claim 13, wherein said 
transmitting means is adapted to effect transmission 
starting from encoded data of a band selected in accor- 
dance with the image frequency in each block. 

15. An image encoding method comprising the steps 
of: 

dividing image information into plural blocks, each 
consisting of plural pixels; 

analyzing image frequency in each block; 

classifying each block into one of plural classes in 
accordance with the image frequency therein; 

separating frequency components of the image fre- 
quency in each block into plural bands in accor- 
dance with the class classified in said classifying 
step; and . . 

encoding the frequency components contained in said 
plural bands, respectively. 

16. A method according to claim 15, wherein said 
encoding step is adapted to vary the number of encoded 

" . . . « « • i ...1*1. — 



3. A method according to claim 1, wherein said ana- 
lyzing step performs an orthogonal transformation of 
the image in each block. # 

4 A method according to claim 1, wherein said en- 
coding step performs different encoding operations in 25 
accordance with the image frequency in each block. 

5. A method according to claim 4, wherein said en- 
coding step varies the number of bands of encoded data 
representing each block, in accordance with the image 
frequency in each block. 

6. A method according to claim 1, further comprising 

a step of: _ 

transmitting encoded data, representing the image 
information of a frame, for each band. 

7. A method according to claim 6, wherein said trans- 35 
mitting step starts transmission from encoded data of a 
band selected in accordance with the image frequency 
in each block. 

8. An image encoding apparatus comprising: 
analyzing means for dividing image information into 40 

plural blocks* each consisting of plural pixels, and 

analyzing image frequency in each block; and 
encoding means for separating frequency compo- 
nents of the image frequency in each block into 
plural bands, and respectively encoding the fre- 45 
quency components contained in said plural bands 
to mutually different predetermined length of 
codes on each band, respectively. 

9. An apparatus according to claim 8, wherein said 
encoding means is adapted to separate the image infor- 
mation into plural bands in different manners in accor- 
dance with the image frequency in each block. 

10. An apparatus according to claim 8, wherein said 
analyzing means is adapted to effect frequency analysis 



class classified by the classifying. 

17. A method according to claim 15, wherein said 
analyzing step includes performance of an orthogonal 
transformation of the image frequency in each block. 

18. A method according to claim 15, wherein said 
encoding step is adapted to encode the image in each 
block into plural encoded data respectively correspond- 
ing to different frequency components. 

19. A method according to claim 18, further corapns- 
30 ing the step of transmitting the encoded data, represent- 
ing the image information of a frame, on a serial basis in 

each band. . . 

20. An image encoding, apparatus comprising: 
analyzing means for dividing image information into 

plural blocks, each consisting of plural pixels, and 
analyzing image frequency in each block; 
classifying means for classifying each block into one 
of plural classes in accordance with the image fre- 
quency therein; and 
encoding means for separating frequency compo- 
nents of the image frequency in each block into 
plural bands in accordance with the class classified 
by said classifying means, and encoding the fre- 
quency, components contained in said plural bands, 
respectively. ^ 

21. An apparatus according to claim 20, wherein said 
encoding means is adapted to vary the number of en- 
coded data representing each block, in accordance with 
said class classified by the classifying means. 

22. An apparatus according to claim 20, wherein said 
analyzing means is adapted to eiTect frequency analysis 
by an orthogonal transformation of the image frequency 
in each block. 

23. An apparatus according to claim 20, wherein said 
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block. 



11. An apparatus according to claim 8, wherein said 
encoding means is adapted to perform different encod- 
ing operations, in accordance with the image frequency 
in each block. m 

12. An apparatus according to claim 11, wherein said 
encoding means is adapted to vary the number of bands 
of the encoded data representing each block, in accor- 
dance with the image frequency in each block. 

13. An apparatus according to claim 8, further com- 65 
prising transmitting means for transmitting, for each 
band, encoded data representing the image information 
of a frame. 
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quency in each block into plural encoded data corre- 
sponding to different frequency components. 

24. An apparatus according to claim 23, further com- 
prising transmitting means for transmitting the encoded 

60 data, representing the image information of a frame, on 
a serial basis in each band. 

25. An image encoding method comprising the steps 

^dividing image information into plural blocks, each 
block having a fixed size and consisting of plural 
pixels; 

discriminating a presence/absence of an edge portion 
of the image in each block; 
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classifying each block into one of plural classes in 
accordance with the presence/absence of an edge 
portion; 

separating the image information in each block into 
plural sub-blocks in accordance with the class clas- 5 
sified in said classifying step; and 

encoding the image contained in said plural sub- 
blocks, respectively. 

26. A method according to claim 25, wherein, in said 
encoding step, the number of the encoded data repre- 10 
senting plural sub-blocks is varied, in accordance with 
the class. 

27. A method according to claim 25, wherein, in said 
discriminating step, edge information in the image in 
each block is discriminated, by analyzing the frequency 15 
of the image information. 

28. A method according to claim 27, wherein, in said 
discriminating step, frequency analysis of the image in 
each block is effected by an orthogonal transformation. 

29. A method according to claim 25, wherein, in said 20 
encoding step, the image in plural sub-blocks is encoded 
into plural encoded data respectively corresponding to 
different frequency components. 

30. An image encoding apparatus comprising: 
. discriminating means for dividing image information 25 

into plural blocks, each block having a fixed size 
and consisting of plural pixels, and discriminating a 
presence/absence of an edge portion of the image 
in each block; 

classifying means for classifying each block into one 30 
of plural classes in accordance with the presen- 
ce/absence of an edge portion; and 

encoding means for separating the image information 
in each block into plural sub-blocks in accordance 
with the class classified by said classifying means, 35 
and for encoding the image information contained 
in said plural sub-blocks, respectively. 

31. An apparatus according to claim 30, wherein said 
encoding means is adapted to vary the number of en- 
coded data representing plural sub-blocks, in accor- 40 
dance with said class. 

32. An apparatus according to claim 30, wherein said 
discriminating means is adapted to discriminate the 
edge information, by frequency analysis of the image in 
each block. " 45 

33. An apparatus according to claim 32, wherein said 
discriminating means is adapted to effect frequency 
analysis by an orthogonal transformation of the image 
in each block. 

34. An apparatus according to claim 30, wherein said 50 
encoding means is adapted to encode the image in each 
block into plural encoded data corresponding to differ- 
ent frequency components. 

35. An image encoding method comprising the steps 
of: 55 

dividing image information into plural blocks, each 
consisting of plural pixels; 

separating frequency components of the image in- 
each block into plural bands; 

encoding the frequency components contained in said 60 
plural bands, respectively; and 

transmitting, on a serial basis in each band, the en- 
coded data representing the image information of a 
frame. 

36. A method according to claim 35, wherein, in said 65 
separating step, the separating operation is performed 
differently in accordance with image frequency in each 
block. 



37. A method according to claim 35, wherein said 
separating step further comprises the step of analyzing 
image" frequency in each block. 

38. A method according to claim 37, wherein, in said 
analyzing step, an orthogonal transformation of the 
image in each block is performed. 

39. A method according to claim 35, wherein, in said 
encoding step, encoding is performed differently in 
accordance with image frequency in each block. 

40. A method according to claim 39, wherein, in said 
encoding step, the number of bands of the encoded data 
representing each' block is varied, in accordance with 
the image frequency in each block. 

41. A method according to claim 35, wherein, in said 
transmitting step, transmission is started from encoded 
data of a selected band in accordance with the image in 
each block. 

42. An image encoding apparatus comprising: 
analyzing means for dividing image information into 

plural blocks, each consisting of plural pixels, and 
analyzing image frequency in each block; 

encoding means for separating frequency compo- 
nents of the image in each block into plural bands, 
and encoding the frequency components contained 
in said plural bands, respectively; and 

transmitting means for transmitting, on a serial basis 
in each band, the encoded data representing the 
image information of a frame. 

43. An apparatus according to claim 42, wherein said 
encoding means is adapted to separate the image infor- 
mation into plural bands in different manners in accor- 
dance with the image frequency in each block. 

44. An apparatus according to claim 42, wherein said 
analyzing means is adapted to effect frequency analysis 
by an orthogonal transformation of the image in each 
block. 

45. An apparatus according to claim 42, wherein said 
encoding means is adapted to perform different encod- 
ing operations, in accordance with the image frequency 
in each block." 

46. An apparatus according to claim 45, wherein said 
encoding means is adapted to vary the number of bands 
of the encoded data representing each block, in accor- 
dance with the image frequency in each block. 

47. An apparatus according to claim 42, wherein said 
transmitting means is adapted to effect transmission 
starting from encoded data of a band selected in accor- 
dance with the image in each block. 

48. An image encoding method comprising the steps 
of: 

dividing image information into plural blocks, each 

consisting of plural pixels; 
separating frequency components of the image in 

each block into plural bands; 
encoding the frequency components contained in 

each of said plural bands; and 
transmitting the image information of a frame, start- 
' ing from the encoded data of a band selected in 

accordance with the image in each block. 

49. A method according to claim 48, wherein, in said 
separating step, the separation operation is performed 
differently in accordance with image frequency in each 
block. 

50. A method according to claim 48, wherein said 
separating step further comprises the step of analyzing 
image frequency in each block. 
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51. A method according to claim 50, wherein, in said 
analyzing step, an orthogonal transformation of the 
image in each block is performed. 

52. A method according to claim 48, wherein, in said 
encoding step, encoding is performed differently in 
accordance with image frequency in each, block. 

53. A method according to claim 52, wherein, in said 
encoding step, the number of bands of the encoded date 
representing each block is varied, in accordance with 
the image frequency in each block. 

54. An image encoding apparatus comprising: 
analyzing means for dividing image information into 

plural blocks, each consisting of plural pixels, and 
analyzing image frequency in each block; 

encoding means for separating frequency compo- 15 
nents of the image in each block into plural bands, 
and encoding the frequency components contained 
in each of said plural bands; and 

transmitting means for transmitting the image infor- 
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65. An image encoding apparatus comprising: 
dividing means for dividing image information into 

plural blocks, each block having a fixed size and 
consisting of plural pixels; 

transforming means for transforming the plural pixels 
into a plurality of frequency components; 

extracting means for extracting first and second sets 
of frequency components from the frequency com- 
ponents of each block; 

encoding means for encoding each of said first and 
second sets of frequency components; 

adding means for adding a parameter relating to said 
first or second set of frequency components to the 
encoded date of said first or second set of fre- 
quency components. 

66. An apparatus according to claim 65, wherein said 
adding means is adapted to add a parameter for image 
transformation. 

67. An apparatus according to claim 65, wherein said 
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a band selected in accordance with the image in 
each block. 

55. An apparatus according to claim 54, wherein said 
encoding means is adapted to separate the image infor- 
mation into plural bands in different manners in accor- 25 
dance with the image frequency in each block. 

56. An apparatus according to claim 54, wherein said 
analyzing means is adapted to effect frequency analysis 
by an orthogonal transformation of the image in each 

block - , . u - -,i 

57. An apparatus according to claim 54, wherein said 

encoding means is adapted to perform different encod- 
ing operations, in accordance with the image frequency 
in each block. ; 

58. An apparatus according to claim 57, wherein said 35 
encoding means is adapted to vary the number of bands 
of the encoded data representing each block, in accor- 
dance with the image frequency in each block. 

59. An image encoding method comprising the steps 

dividing image information into plural blocks, each 
block having a fixed size and consisting of plural 
pixels; 

transforming the plural pixels into a plurality of fre- 
quency components; 

extracting first and second set of frequency compo- 
nents from the frequency components of each 
block; 

encoding each of said first and second sets of fre- 
quency components; 

adding a parameter relating to said first or second set 
of frequency components to the encoded data of 
said first or second set of frequency components. 

60. A method according to claim 59, wherein, in said 
extracting step, frequency components of the image in 55 
each block are separated into plural sub-blocks. 

61. A method according to claim 59, wherein, in said 
adding step, a parameter for image transformation is 

» dded * _ , . 

62. A method according to claim 59, wherein said 
extracting step further comprises the step of analyzing 
image frequency in each block. 

63. A method according to claim 62, wherein, in said 
transforming step, an orthogonal transformation of the 
image in each block is performed. 

64. A method according to claim 59, wherein, in said 
encoding step, encoding is performed differently in 
accordance with image frequency in each block. 



ond set of frequency components by different methods, 
respectively. ... 

68. An apparatus according to claim 65, wherein said 
transforming means is adapted to effect frequency anal- 
ysis by an orthogonal transformation of the image in 
each block. 

69. An apparatus according to claim 65, wherein said 
encoding means is adapted to perform different encod- 

30 ing operations, in accordance with the image frequency 
in each block. 

70. The image decoding method comprising steps of: 
entering plural encoded data obtained by encoding 

image information of different frequency compo- 
nents; 

storing first image information obtained by decoding 
of the encoded data of a first frequency component; 
and r ' 

adding second image information, obtained by decod- 
ing of the encoded data of a second frequency 
component, to said first image information in a real 
image space. 

71. A method according to claim 70, wherein, in said 
entering step, data encoded for plural blocks each con- 

45 sisting of plural pixels is entered. 

72. A method according to claim 70, further compris- 
ing the step of displaying the first image information 
stored in said storing step. 

73. A method according to claim 70, further compris- 
ing the step of storing the image information obtained in 
said adding step. 

74. An image decoding apparatus comprising: 
input means for entering plural encoded data ob- 
tained by encoding image information for different 
frequency components; 

decoding means for decoding the encoded data to 

obtain decoded image data; 
memory means for storing the decoded image infor- 
mation; and 

adding means for adding first image information ob- 
tained by decoding the encoded data of a first fre- 
quency component and stored in said memory 
means, to second image information obtained by 
decoding the encoded data of a second frequency 
component, in a real image space. 

75. An apparatus according to claim 74, further com- 
prising display means for displaying the first image 
information stored in said memory means. 
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76. An apparatus according to claim 74, wherein said 
memory means is further adapted to store the image 
information obtained by addition in said adding means. 

77. An image encoding method comprising the steps 
Of: 5 

dividing image information into plural blocks, each 

consisting of plural pixels; 
analyzing image frequency in each block; 
classifying each block into one of plural classes in 

accordance with a frequency of the image therein; 10 
separating frequency components of the image in 

each block into a band or bands the number of 

which is in accordance with the class classified in 

said classifying step; and 
encoding the frequency components contained in said IS 

band or bands separated in said separating step, 

respectively. 

78. An image encoding method according to claim 
77, wherein, in said encoding step, the number of en- 
coded data representing each block is varied in accor- 20 
dance with class. 

79. An image encoding method according to claim 
77, wherein said analyzing step includes performing an 
orthogonal transformation of the image in each block. 

80. An image encoding method according to claim 25 
77, wherein said encoding step includes encoding the 
image in each block into plural encoded data respec- 
tively corresponding to different frequency compo- 
nents. 

81. An image encoding method according to claim 30 
80, further comprising the step of transmitting on each 
frequency component the encoded data representing 
the image information of a frame. 

82. An image encoding apparatus comprising: 
analyzing means for dividing image information into 35 

plural blocks, each consisting of plural pixels, and 
analyzing image frequency in each block; 

classifying for classifying each block into one of plu- 
ral classes in accordance with the image frequency 
therein; 40 

separating means for separating frequency compo- 
nents of the image in each block into a band or 
bands the number of which is in accordance with 
the class classified by said classifying means; and 

encoding means encoding the frequency components 45 
contained in said band or bands separated by said 
separating means. 

83. An image encoding apparatus according to claim 
82, wherein said encoding means is adapted to vary the 
number of encoded data representing each block in 50 
accordance with class. 

84. An image encoding apparatus according to claim 
82, wherein said analyzing means is adapted to effect 
frequency analysis by an orthogonal transformation of 
the image in each block. 35 

85. An image encoding apparatus according to claim 
82, wherein said encoding means is adapted to encode 
the image in each block into plural encoded data respec- 
tively corresponding to different frequency compo- 
nents. 60 

86. An image encoding apparatus according to claim 
82, further comprising transmitting means for transmit- 
ting on each frequency component the encoded data 
representing the image information of a frame. 

87. An image encoding apparatus comprising: 65 
dividing means for dividing image data into plural 

blocks, each block having a fixed size and consist- 
ing of plural pixels; 
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transformation means for performing an orthogonal 
transformation of the image data in said plural 
blocks and outputting plural frequency compo- 
nents; 

first encoding means for encoding a first frequency 
component among the plural frequency compo- 
nents and outputting first coded data; 

second encoding means for encoding a second fre- 
quency component, the frequency of which is 
higher than the first frequency component, and 
outputting second coded data; and 

transmission means for transmitting the first coded 
data of plural blocks of a picture and the second 
coded data of plural blocks of the picture; 

wherein said transmission means adds boundary in- 
formation between the first coded data and the 
second coded data, and transmits the first coded 
data of plural blocks, the boundary information and 
the second coded data of plural blocks. 

88. An image encoding apparatus according to claim 
87, wherein said transmission means is further adapted 
to transmit data representing image type of an image 
represented by the image data. 

89. An image encoding apparatus according to claim 
87, wherein said first and second encoding means is 
adapted to perform different encodings in accordance 
with a frequency of the image data transmitted by said 
transmission means. 

90. An image encoding apparatus according to claim 
89, wherein said boundary information represents an 
information for decoding the second coded data. 

91. An image encoding method comprising the steps 
of: 

dividing image information into plural blocks, each 
block having a fixed size and consisting of plural 
pixels; 

transforming the image information into plural fre- 
quency components; 

encoding a first frequency component among the 
plural frequency components in a block and out- 
putting first coded data; 

encoding a second frequency component, the fre- 
quency of which is higher than the first frequency . 
component in the block, and outputting second 
coded data; 

repeating said transforming step and plural encoding 
steps for plural blocks; and 

transmitting the first coded data of plural blocks and 
the second coded data of plural blocks; 

wherein in said transmitting step, the first coded data 
of plural blocks, boundary information between the 
first and the second coded data and the second 
coded data of plural blocks, are transmitted in this 
order. 

92. An image encoding method according to claim 
91, wherein said transforming step includes performing 
an orthogonal transformation of an image in each block. 

93. An image encoding method according to claim 
91, wherein said encoding * step includes performing . 
different encoding operations in accordance with a 
frequency component in each block. 

94. An image encoding method according to claim 
91, wherein, in said encoding step, different encodings 
are performed in accordance with a frequency compo- 
nent transmitted in said transmitting step. 

95. An image encoding method according to claim 
94, wherein said encoding step includes performing 
different encodings in a code length in accordance with 
a frequency component. 
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